Mobile terminal, display device and controlling method thereof

ABSTRACT

A display device, a mobile terminal, and a method for displaying a second screen image are discussed. The display device according to one embodiment includes an interface unit configured to be connected to a mobile terminal having a first display unit displaying a first screen image in a first display direction; a second display unit; and a controller configured to receive information related to the first screen image, and display a monitor window for displaying a second screen image corresponding to the first screen image on the second display unit. The second screen image is displayed in the first display direction. The controller is further configured to receive a user command to intend the monitor window to be oriented in a second display direction and control the monitor window to be oriented in the second display direction according to the user command, and transmit a control signal.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of co-pending U.S. application Ser.No. 13/149,096 filed on May 31, 2011, which claims the benefit of theInternational Patent Application No. PCT/KR2010/005341 filed on Aug. 13,2010. The entire contents of these applications are hereby incorporatedby reference as fully set forth herein.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to a mobile terminal, and moreparticularly, to a mobile terminal, display device and controllingmethod thereof. Although the present invention is suitable for a widescope of applications, it is particularly suitable for enabling datacommunications between a mobile terminal and a display device when themobile terminal and the display device are connected together in furtherconsideration of user's convenience.

Discussion of the Related Art

A mobile terminal is a device which may be configured to perform variousfunctions. Examples of such functions include data and voicecommunications, capturing images and video via a camera, recordingaudio, playing music files and outputting music via a speaker system,and displaying images and video on a display. Some terminals includeadditional functionality which supports game playing, while otherterminals are also configured as multimedia players. More recently,mobile terminals have been configured to receive broadcast and multicastsignals which permit viewing of contents, such as videos and televisionprograms.

Generally, terminals can be classified into mobile terminals andstationary terminals according to a presence or non-presence ofmobility. And, the mobile terminals can be further classified intohandheld terminals and vehicle mount terminals according to availabilityfor hand-carry.

There are ongoing efforts to support and increase the functionality ofmobile terminals. Such efforts include software and hardwareimprovements, as well as changes and improvements in the structuralcomponents which form the mobile terminal.

The mobile terminal is connected to such a display device as a notebookcomputer, a tablet computer, a personal computer, a television set andthe like by wire or wireless and can then perform data communicationsin-between. When the data communications are performed between themobile terminal and the display device, the demand for a method ofdisplaying information on the data communications in-between on themobile terminal and the display device is ongoing.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a mobile terminal,display device and controlling method thereof that substantially obviateone or more problems due to limitations and disadvantages of the relatedart.

An object of the present invention is to provide a mobile terminal,display device and controlling method thereof, by which when the datacommunications are performed between the mobile terminal and the displaydevice, information on the data communications in-between can bedisplayed on the mobile terminal and the display device in furtherconsideration of terminal user's convenience.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amobile terminal according to the present invention includes a housing, asensor unit configured to sense an orientation direction of the housing,a first display unit provided to one side of the housing, the firstdisplay unit configured to display a first screen image, an interfaceunit configured to be connected to an external display device having asecond display unit, and a controller configured to: control a monitorwindow for displaying a second screen image corresponding to the firstscreen image to be generated from the second display unit by providinginformation on the first screen image to the external display device,and control the monitor window to be displayed within the second displayunit according to the orientation direction of the housing by providingthe sensed orientation direction of the housing to the external displaydevice.

In another aspect of the present invention, a display device includes aninterface unit configured to connect an external mobile terminal havinga first display unit displaying a first screen image thereon, a seconddisplay unit, and a controller configured to: control a monitor windowdisplaying a second screen image corresponding to the first screen imageto be generated from the second display unit by receiving information onthe first screen image from the external mobile terminal, receive anorientation direction of a housing of the mobile terminal, and controlthe monitor window to be displayed on the second display unit in thereceived orientation direction.

In another aspect of the present invention, a method of controlling amobile terminal includes displaying a first screen image on a firstdisplay unit provided to one side of a housing of the mobile terminal,connecting the mobile terminal to an external display device having asecond display unit, providing information on the first screen image tothe external display device, controlling a monitor window displaying asecond screen image corresponding to the first screen image to begenerated from the second display unit, sensing an orientation directionof the housing and providing the sensed orientation direction of thehousing to the external display device to control the monitor window tobe displayed along the sensed orientation direction.

In another aspect of the present invention, a method of controlling adisplay device includes connecting an external mobile terminal having afirst display unit displaying a first screen image thereon to thedisplay device having a second display unit, controlling a monitorwindow displaying a second screen image corresponding to the firstscreen image to be generated from the second display unit by receivinginformation on the first screen image from the external mobile terminal,receiving an orientation direction of a housing of the external mobileterminal, and controlling the monitor window to be displayed on thesecond display unit in the received orientation direction.

In another aspect of the present invention, a mobile terminal includes afirst display unit configured to display a first screen image thereon,an interface unit configured to be connected to an external displaydevice having a second display unit, and a controller configured tocontrol a monitor window for displaying a second screen imagecorresponding to the first screen image to be generated on the seconddisplay unit by providing information on the first screen image to theexternal display device, and control the monitor window to be enlargedon the second display unit when the first screen image is zoomed in onthe first display unit.

In another aspect of the present invention, a display device includes aninterface unit configured to be connected to an external mobile terminalhaving a first display unit displaying a first screen image thereon, asecond display unit, and a controller configured to control a monitorwindow displaying a second screen image corresponding to the firstscreen image to be generated on the second display unit by receivinginformation on the first screen image from the external mobile terminal,and control the monitor window to be enlarged on the second display unitwhen the first screen image is zoomed in on the first display unit.

In another aspect of the present invention, a method of controlling amobile terminal includes displaying a first screen image on a firstdisplay unit provided to one side of a housing of the mobile terminal,connecting the mobile terminal to an external display device having asecond display unit, providing information on the first screen image tothe external display device, controlling a monitor window for displayinga second screen image corresponding to the first screen image to begenerated on the second display unit, and controlling the monitor windowto be enlarged on the second display unit when the first screen image iszoomed in on the first display unit.

In another aspect of the present invention, a method of controlling adisplay device includes connecting an external mobile terminal having afirst display unit displaying a first screen image thereon to thedisplay device having a second display unit, controlling a monitorwindow displaying a second screen image corresponding to the firstscreen image to be generated on the second display unit by receivinginformation on the first screen image from the external mobile terminal,and controlling the monitor window to be enlarged on the second displayunit when the first screen image is zoomed in on the first display unit.

In another aspect of the present invention, a display device includes afirst display unit configured to display a first display unit configuredto display a first screen image thereon, an interface unit configured tobe connected to an external display device having a second display unit,and a controller configured to: control a monitor window for displayinga second screen image corresponding to the first screen image to begenerated on the second display unit by providing information on thefirst screen image to the external display device, and control thesecond screen image to be zoomed out when the monitor window is enlargedon the second display unit.

In another aspect of the present invention, a display device includes aninterface unit configured to connect an external mobile terminal havinga first display unit displaying a first screen image thereon, a seconddisplay unit, and a controller configured to: control a monitor windowdisplaying a second screen image corresponding to the first screen imageto be generated on the second display unit by receiving information onthe first screen image from the external mobile terminal, and controlthe second screen image to be zoomed out when the monitor window isenlarged on the second display unit.

In another aspect of the present invention, a method of controlling amobile terminal includes displaying a first screen image on a firstdisplay unit provided to one side of a housing of the mobile terminal,connecting the mobile terminal to an external display device having asecond display unit, providing information on the first screen image tothe external display device, controlling a monitor window for displayinga second screen image corresponding to the first screen image to begenerated on the second display unit, and controlling the second screenimage to be zoomed out when the monitor window is enlarged on the seconddisplay unit.

In a further aspect of the present invention, a method of controlling adisplay device includes connecting the display device having a seconddisplay unit to an external mobile terminal having a first display unitdisplaying a first screen image thereon, controlling a monitor windowdisplaying a second screen image corresponding to the first screen imageto be generated on the second display unit by receiving information onthe first screen image from the external mobile terminal, andcontrolling the second screen image to be zoomed out when the monitorwindow is enlarged on the second display unit.

Accordingly, the present invention provides the following effects and/oradvantages.

First of all, according to at least one of the embodiments of thepresent invention, as the mobile terminal and the display device areconnected to each other, when a monitor window related to a display ofthe mobile terminal is displayed on the display device, a terminal useris facilitated to switch an orientation direction of the monitor byswitching an orientation direction of a housing of the mobile terminalif necessary.

Secondly, according to at least one of the embodiments of the presentinvention, when the monitor window related to the display of the mobileterminal is displayed on the display device, the monitor window isdisplayed by not blocking a previous object displayed on the displaydevice. Therefore, the present invention can prevent the inconveniencethat may be caused to a terminal user as the monitor window blocks theprevious object.

Thirdly, according to at least one of the embodiments of the presentinvention, a zoom-in or zoom-out of the display of the mobile terminal,a zoom-in (or enlargement) or zoom-out (or reduction) of the displaywithin the monitor window, and an enlargement and reduction of themonitor window itself are performed as being organically associated witheach other, whereby a terminal user is further facilitated to view thedisplay of the mobile terminal and the display of the display device.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. The above and other aspects, features, and advantages of thepresent invention will become more apparent upon consideration of thefollowing description of preferred embodiments, taken in conjunctionwith the accompanying drawing figures. In the drawings:

FIG. 1 is a block diagram of a mobile terminal according to oneembodiment of the present invention;

FIG. 2 is a block diagram of a display device according to oneembodiment of the present invention;

FIG. 3 is a diagram of a mobile terminal and a display device connectedto each other to implement an embodiment of the present invention;

FIG. 4 is a flowchart according to an embodiment of the presentinvention;

FIG. 5 is a diagram of screens of a display unit of a display deviceaccording to an embodiment of the present invention;

FIGS. 6 and 7 are diagrams of a front side of a mobile terminal and adisplay unit of a display device according to an embodiment of thepresent invention;

FIG. 8 is a diagram of a screen of a display unit of a display deviceaccording to an embodiment of the present invention;

FIGS. 9 and 10 are diagrams of a front side of a mobile terminal and adisplay unit of a display device according to an embodiment of thepresent invention;

FIG. 11 is a flowchart according to an embodiment of the presentinvention;

FIG. 12 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 13 is a flowchart according to an embodiment of the presentinvention;

FIG. 14 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 15 is a flowchart according to an embodiment of the presentinvention;

FIG. 16 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 17 is a flowchart according to an embodiment of the presentinvention;

FIG. 18 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 19 is a flowchart according to an embodiment of the presentinvention;

FIG. 20 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 21 is a flowchart according to an embodiment of the presentinvention;

FIG. 22 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 23 is a flowchart according to an embodiment of the presentinvention;

FIG. 24 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 25 is a flowchart according to an embodiment of the presentinvention;

FIG. 26 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 27 is a flowchart according to an embodiment of the presentinvention;

FIG. 28 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 29 is a flowchart according to an embodiment of the presentinvention;

FIG. 30 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention;

FIG. 31 is a flowchart according to an embodiment of the presentinvention; and

FIG. 32 is a diagram of a front side of a mobile terminal and a displayunit of a display device according to an embodiment of the presentinvention.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description, reference is made to theaccompanying drawing figures which form a part hereof, and which show byway of illustration specific embodiments of the invention. It is to beunderstood by those of ordinary skill in this technological field thatother embodiments may be utilized, and structural, electrical, as wellas procedural changes may be made without departing from the scope ofthe present invention. Wherever possible, the same reference numberswill be used throughout the drawings to refer to the same or similarparts.

As used herein, the suffixes ‘module’, ‘unit’ and ‘part’ are used forelements in order to facilitate the disclosure only. Therefore,significant meanings or roles are not given to the suffixes themselvesand it is understood that the ‘module’, ‘unit’ and ‘part’ can be usedtogether or interchangeably.

First of all, a mobile terminal according to the present invention isdescribed as follows.

The present invention can be applicable to a various types of terminals.Examples of such terminals include mobile terminals, such as mobilephones, smart phones, notebook computers (laptop computers), digitalbroadcast terminals, personal digital assistants, portable multimediaplayers (PMP) and navigators.

FIG. 1 is a block diagram of a mobile terminal 100 in accordance with anembodiment of the present invention. FIG. 1 shows the mobile terminal100 according to one embodiment of the present invention includes awireless communication unit 110, an A/V (audio/video) input unit 120, auser input unit 130, a sensing unit 140, an output unit 150, a memory160, an interface unit 170, a controller 180, a power supply unit 190and the like. FIG. 1 shows the mobile terminal 100 having variouscomponents, but it is understood that implementing all of theillustrated components is not a requirement. Greater or fewer componentsmay alternatively be implemented.

In the following description, the above elements of the mobile terminal100 are explained in sequence.

First of all, the wireless communication unit 110 typically includes oneor more components which permits wireless communication between themobile terminal 100 and a wireless communication system or networkwithin which the mobile terminal 100 is located. For instance, thewireless communication unit 110 can include a broadcast receiving module111, a mobile communication module 112, a wireless internet module 113,a short-range communication module 114, a position-location module 115and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingserver via a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrialchannel. The broadcast managing server generally refers to a serverwhich generates and transmits a broadcast signal and/or broadcastassociated information or a server which is provided with a previouslygenerated broadcast signal and/or broadcast associated information andthen transmits the provided signal or information to a terminal. Thebroadcast signal may be implemented as a TV broadcast signal, a radiobroadcast signal, and a data broadcast signal, among others. If desired,the broadcast signal may further include a broadcast signal combinedwith a TV or radio broadcast signal.

The broadcast associated information includes information associatedwith a broadcast channel, a broadcast program, a broadcast serviceprovider, etc. And, the broadcast associated information can be providedvia a mobile communication network. In this instance, the broadcastassociated information can be received by the mobile communicationmodule 112.

The mobile communication module 112 transmits/receives wireless signalsto/from one or more network entities (e.g., base station, externalterminal, server, etc.) via a mobile network such as GSM (Global Systemfor Mobile communications), CDMA (Code Division Multiple Access), WCDMA(Wideband CDMA) and so on. Such wireless signals may represent audio,video, and data according to text/multimedia message transceivings,among others.

The wireless internet module 113 supports Internet access for the mobileterminal 100. This module may be internally or externally coupled to themobile terminal 100. In this instance, the wireless Internet technologycan include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband),Wimax (World Interoperability for Microwave Access), HSDPA (High SpeedDownlink Packet Access), GSM, CDMA, WCDMA, LTE (Long Term Evolution)etc.

Wireless internet access by Wibro, HSPDA, GSM, CDMA, WCDMA, LTE or thelike is achieved via a mobile communication network. In this aspect, thewireless internet module 113 configured to perform the wireless internetaccess via the mobile communication network can be understood as a sortof the mobile communication module 112.

The short-range communication module 114 facilitates relativelyshort-range communications. Suitable technologies for implementing thismodule include radio frequency identification (RFID), infrared dataassociation (IrDA), ultra-wideband (UWB), as well at the networkingtechnologies commonly referred to as Bluetooth and ZigBee, to name afew.

The position-location module 115 identifies or otherwise obtains thelocation of the mobile terminal 100. If desired, this module may beimplemented with a global positioning system (GPS) module.

According to the current technology, the GPS module 115 can preciselycalculate current 3-dimensional position information based on at leastone of longitude, latitude and altitude and direction (or orientation)by calculating distance information and precise time information from atleast three satellites and then applying triangulation to the calculatedinformation. Currently, location and time information are calculatedusing three satellites, and errors of the calculated location positionand time information are then amended using another satellite. Besides,the GPS module 115 can calculate speed information by continuouslycalculating a real-time current location.

Referring to FIG. 1, the audio/video (A/V) input unit 120 is configuredto provide audio or video signal input to the mobile terminal 100. Asshown, the A/V input unit 120 includes a camera 121 and a microphone122. The camera 121 receives and processes image frames of stillpictures or video, which are obtained by an image sensor in a video callmode or a photographing mode. And, the processed image frames can bedisplayed on the display 151.

The image frames processed by the camera 121 can be stored in the memory160 or can be externally transmitted via the wireless communication unit110. Optionally, at least two cameras 121 can be provided to the mobileterminal 100 according to environment of usage.

The microphone 122 receives an external audio signal while the portabledevice is in a particular mode, such as phone call mode, recording modeand voice recognition. This audio signal is processed and converted intoelectric audio data. The processed audio data is transformed into aformat transmittable to a mobile communication base station via themobile communication module 112 in case of a call mode. The microphone122 typically includes assorted noise removing algorithms to removenoise generated in the course of receiving the external audio signal.

The user input unit 130 generates input data responsive to usermanipulation of an associated input device or devices. Examples of suchdevices include a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch, etc.

The sensing unit 140 provides sensing signals for controlling operationsof the mobile terminal 100 using status measurements of various aspectsof the mobile terminal 100. For instance, the sensing unit 140 maydetect an open/close status of the mobile terminal 100, relativepositioning of components (e.g., a display and keypad) of the mobileterminal 100, a change of position of the mobile terminal 100 or acomponent of the mobile terminal 100, a presence or absence of usercontact with the mobile terminal 100, orientation oracceleration/deceleration of the mobile terminal 100. For example, thesensing unit 140 includes at least one of a gyroscope sensor,acceleration sensor, a geomagnetic sensor and the like. As an example,consider the mobile terminal 100 being configured as a slide-type mobileterminal. In this configuration, the sensing unit 140 may sense whethera sliding portion of the mobile terminal 100 is open or closed. Otherexamples include the sensing unit 140 sensing the presence or absence ofpower provided by the power supply 190, the presence or absence of acoupling or other connection between the interface unit 170 and anexternal device. And, the sensing unit 140 can include a proximitysensor 141.

The output unit 150 generates outputs relevant to the senses of sight,hearing, touch and the like. And, the output unit 150 includes thedisplay 151, an audio output module 152, an alarm unit 153, a hapticmodule 154, a projector module 155 and the like.

The display 151 is typically implemented to visually display (output)information associated with the mobile terminal 100. For instance, ifthe mobile terminal 100 is operating in a phone call mode, the displaywill generally provide a user interface (UI) or graphical user interface(GUI) which includes information associated with placing, conducting,and terminating a phone call. As another example, if the mobile terminal100 is in a video call mode or a photographing mode, the display 151 mayadditionally or alternatively display images which are associated withthese modes, the UI or the GUI.

The display module 151 may be implemented using known displaytechnologies including, for example, a liquid crystal display (LCD), athin film transistor-liquid crystal display (TFT-LCD), an organiclight-emitting diode display (OLED), a flexible display and athree-dimensional display. The mobile terminal 100 may include one ormore of such displays.

Some of the above displays can be implemented in a transparent oroptical transmittive type, which can be named a transparent display. Asa representative example for the transparent display, there is TOLED(transparent OLED) or the like. A rear configuration of the display 151can be implemented in the optical transmittive type as well. In thisconfiguration, a user can see an object in rear of a terminal body viathe area occupied by the display 151 of the terminal body.

At least two displays 151 can be provided to the mobile terminal 100 inaccordance with the implemented configuration of the mobile terminal100. For instance, a plurality of displays can be arranged on a singleface of the mobile terminal 100 as being spaced apart from each other orbeing built in one body. Alternatively, a plurality of displays can bearranged on different faces of the mobile terminal 100.

When the display 151 and a sensor for detecting a touch action(hereinafter called ‘touch sensor’) configures a mutual layer structure(hereinafter called ‘touchscreen’), the display 151 can be an inputdevice as well as an output device. In this instance, the touch sensorcan be configured as a touch film, a touch sheet, a touchpad or thelike.

The touch sensor can be configured to convert a pressure applied to aspecific portion of the display 151 or a variation of a capacitancegenerated from a specific portion of the display 151 to an electricinput signal. Moreover, the touch sensor can be configured to detect apressure of a touch as well as a touched position or size.

If a touch input is made to the touch sensor, signal(s) corresponding tothe touch is transferred to a touch controller. The touch controllerprocesses the signal(s) and then transfers the processed signal(s) tothe controller 180. Therefore, the controller 180 knows whether aprescribed portion of the display 151 is touched.

Referring to FIG. 1, the proximity sensor 141 can be provided to aninternal area of the mobile terminal 100 enclosed by the touchscreen oraround the touchscreen. The proximity sensor is the sensor that detectsa presence or non-presence of an object approaching a prescribeddetecting surface or an object existing around the proximity sensorusing an electromagnetic field strength or infrared ray withoutmechanical contact. Hence, the proximity sensor 141 has durabilitylonger than that of a contact type sensor and also has utility widerthan that of the contact type sensor.

The proximity sensor 141 can include one of a transmittive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacity proximity sensor, a magnetic proximity sensor, aninfrared proximity sensor and the like. In case that the touchscreenincludes the electrostatic capacity proximity sensor, it is configuredto detect the proximity of a pointer using a variation of electric fieldaccording to the proximity of the pointer. In this instance, thetouchscreen (touch sensor) can be classified as the proximity sensor.

The proximity sensor 141 detects a proximity touch and a proximity touchpattern (e.g., a proximity touch distance, a proximity touch duration, aproximity touch position, a proximity touch shift state, etc.). And,information corresponding to the detected proximity touch action and thedetected proximity touch pattern can be output to the touchscreen.

The audio output module 152 functions in various modes including acall-receiving mode, a call-placing mode, a recording mode, a voicerecognition mode, a broadcast reception mode and the like to outputaudio data which is received from the wireless communication unit 110 oris stored in the memory 160. During operation, the audio output module152 outputs audio relating to a particular function (e.g., callreceived, message received, etc.). The audio output module 152 is oftenimplemented using one or more speakers, buzzers, other audio producingdevices, and combinations thereof.

The alarm unit 153 is output a signal for announcing the occurrence of aparticular event associated with the mobile terminal 100. Typical eventsinclude a call received event, a message received event and a touchinput received event. The alarm unit 153 can output a signal forannouncing the event occurrence by way of vibration as well as video oraudio signal. The video or audio signal can be output via the display151 or the audio output unit 152. Hence, the display 151 or the audiooutput module 152 can be regarded as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that can besensed by a user. Vibration is a representative one of the tactileeffects generated by the haptic module 154. Strength and pattern of thevibration generated by the haptic module 154 are controllable. Forinstance, different vibrations can be output as being synthesizedtogether or can be output in sequence.

The memory 160 is generally used to store various types of data tosupport the processing, control, and storage requirements of the mobileterminal 100. Examples of such data include program instructions forapplications operating on the mobile terminal 100, contact data,phonebook data, messages, audio, still pictures (or photo), movingpictures, etc. And, a recent use history or a cumulative use frequencyof each data (e.g., use frequency for each phonebook, each message oreach multimedia) can be stored in the memory unit 160. Moreover, datafor various patterns of vibration and/or sound output in case of a touchinput to the touchscreen can be stored in the memory 160.

The memory 160 may be implemented using any type or combination ofsuitable volatile and non-volatile memory or storage devices includinghard disk, random access memory (RAM), static random access memory(SRAM), electrically erasable programmable read-only memory (EEPROM),erasable programmable read-only memory (EPROM), programmable read-onlymemory (PROM), read-only memory (ROM), magnetic memory, flash memory,magnetic or optical disk, multimedia card micro type memory, card-typememory (e.g., SD memory, XD memory, etc.), or other similar memory ordata storage device. And, the mobile terminal 100 can operate inassociation with a web storage for performing a storage function of thememory 160 on Internet.

The interface unit 170 is often implemented to couple the mobileterminal 100 with external devices. The interface unit 170 receives datafrom the external devices or is supplied with the power and thentransfers the data or power to the respective elements of the mobileterminal 100 or enables data within the mobile terminal 100 to betransferred to the external devices. The interface unit 170 may beconfigured using a wired/wireless headset port, an external chargerport, a wired/wireless data port, a memory card port, a port forcoupling to a device having an identity module, audio input/outputports, video input/output ports, an earphone port and/or the like.

Considering that the wireless internet module 113 and the short-rangecommunication module 114 are usable as the wireless data ports, each ofthe wireless internet module 113 and the short-range communicationmodule 114 can be understood as a sort of the interface unit 170.

The identity module is the chip for storing various kinds of informationfor authenticating a use authority of the mobile terminal 100 and caninclude User Identify Module (UIM), Subscriber Identify Module (SIM),Universal Subscriber Identity Module (USIM) and/or the like. A devicehaving the identity module (hereinafter called ‘identity device’) can bemanufactured as a smart card. Therefore, the identity device isconnectable to the mobile terminal 100 via the corresponding port.

When the mobile terminal 100 is connected to an external cradle, theinterface unit 170 becomes a passage for supplying the mobile terminal100 with a power from the cradle or a passage for delivering variouscommand signals input from the cradle by a user to the mobile terminal100. Each of the various command signals input from the cradle or thepower can operate as a signal enabling the mobile terminal 100 torecognize that it is correctly loaded in the cradle.

The controller 180 typically controls the overall operations of themobile terminal 100. For example, the controller 180 performs thecontrol and processing associated with voice calls, data communications,video calls, etc. The controller 180 may include a multimedia module 181that provides multimedia playback. The multimedia module 181 may beconfigured as part of the controller 180, or implemented as a separatecomponent.

Moreover, the controller 180 can perform a pattern (or image)recognizing process for recognizing a writing input and a picturedrawing input carried out on the touchscreen as characters or images,respectively.

The power supply unit 190 provides power required by the variouscomponents for the mobile terminal 100. The power may be internal power,external power, or combinations thereof.

Various embodiments described herein may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination thereof. For a hardware implementation,the embodiments described herein may be implemented within one or moreapplication specific integrated circuits (ASICs), digital signalprocessors (DSPs), digital signal processing devices (DSPDs),programmable logic devices (PLDs), field programmable gate arrays(FPGAs), processors, controllers, micro-controllers, microprocessors,other electronic units designed to perform the functions describedherein, or a selective combination thereof. Such embodiments may also beimplemented by the controller 180.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which perform one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory such as the memory 160, and executed by acontroller or processor, such as the controller 180.

In the above description, so far, the mobile terminal 100 according toan embodiment of the present invention is described. In the followingdescription, a display device according to an embodiment of the presentinvention is explained. First of all, no limitation is put on a displaydevice described in this disclosure as long as the display device canreceive and display information on a display of the mobile terminal 100by being connected to the mobile terminal 100 for communicationsin-between. For example, the display device can include, but is notlimited to, one of a notebook computer (laptop), a tablet computer, adesktop computer, a television set (e.g., a digital TV set, a smart TVset, etc.) and the like.

FIG. 2 is a block diagram of a display device 200 according to oneembodiment of the present invention. Referring to FIG. 2, the displaydevice 200 according to one embodiment of the present invention includesa wireless communication unit 210, an A/V (audio/video) input unit 220,a user input unit 230, an output unit 250, a memory 260, an interfaceunit 270, a controller 280, a power supply unit 290 and the like.

The wireless communication unit 210 can include a wireless internetmodule 213 and a short-range communication module 214. The output unit250 can include a display unit 251 and an audio output module 253.

Because the components of the display device 200 are identical or mostlysimilar to the corresponding components of the above-described mobileterminal, their details are omitted from the following description forclarity of this disclosure.

Because the components shown in FIG. 2 are not entirely mandatory, moreor less components can be implemented for the display device 200. Forinstance, when the display device 200 is a television, it can furtherinclude a broadcast receiving module. Moreover, when the display device200 is the television, it may not be provided with the wireless internetmodule. Of course, the display device 200 can include the wirelessinternet module. Because the broadcast receiving module is identical ormostly similar to the former broadcast receiving module 111 of themobile terminal 100 described with reference to FIG. 1, its details areomitted from the following description for clarity of this disclosure.

In the following description, how to connect the mobile terminal 100 andthe display device 200 together is explained with reference to FIG. 3.

FIG. 3 is a diagram of a mobile terminal and a display device connectedto each other to implement an embodiment of the present invention.Referring to FIG. 3, the mobile terminal 100 and the display device 200can be connected to each other via the interface unit 170 of the mobileterminal 100 and the interface unit 270 of the display device 200. Theconnection between the mobile terminal 100 and the display device 200can be established by wire communication or wireless communication(e.g., short-range communication, wireless internet communication,etc.).

FIG. 3 shows a state in which the mobile terminal 100 and the displaydevice 200 are connected to each other. For clarity and convenience ofthe following description, in order to respectively identify thecomponents of the mobile terminal 100 and the display device 200,‘first’ is prefixed to a corresponding one of the components of themobile terminal 100, while ‘second’ is prefixed to a corresponding oneof the components of the display device 200.

For instance, the display unit 151 of the mobile terminal 100 is named afirst display unit 151, the controller 180 of the mobile terminal 100 isnamed a first controller 180, the display unit 251 of the display device200 is named a second display unit 251, and the controller 280 of thedisplay device 200 is named a second controller 280. In addition, animage displayed on the first display unit 151 is named a first screenimage 300.

Once the connection between the mobile terminal 100 and the displaydevice 200 is established, the mobile terminal 100 can provideinformation on a first screen image 300 displayed on the first displayunit 151 to the display device 200. In this instance, an application(e.g., a plug-in software, etc.) for processing the information on thefirst screen image 300 received from the mobile terminal 100 can beinstalled at the display device 200 in advance.

Hence, when the mobile terminal 100 and the display device 200 areconnected to each other, the second controller 280 of the display device200 can control a monitor window 400 for a first screen image 300 to bedisplayed on the second display unit 251. The second controller 280 ofthe display device 200 then controls an image corresponding to the firstscreen image 300 to be displayed on the monitor window 400. For clarityof the following description, in order to be discriminated from thefirst screen image 300 displayed in the mobile terminal 100, the imagedisplayed on the monitor window 400 is named a second screen image 500.

In particular, the monitor window 400 can have a shape identical orsimilar to one face of a housing to which the first display unit 151 ofthe mobile terminal 100 is attached. Therefore, in case that prescribedkey buttons 130 are provided to the face of the housing, soft keybuttons 430 having the same shapes of the prescribed key buttons can beformed at the corresponding locations, respectively.

If the soft key button 430 is clicked by a mouse in the display device200 (or the soft key button 430 is touched when the second display unit251 includes a touchscreen), the second controller 280 of the displaydevice 200 can send a control signal, which indicates that the soft keybutton 430 has been manipulated in the display device 200, to the mobileterminal 100.

If so, the first controller 180 of the mobile terminal 100 receives thecontrol signal and can then control a specific function corresponding tothe manipulation of the prescribed key button 130 matching themanipulated soft key button 430 to be executed in the mobile terminal100. And, the first controller 180 of the mobile terminal 100 cancontrol an image according to the executed specific function to bedisplayed as the first screen image 300 on the first display unit 151.Subsequently, the first controller 180 of the mobile terminal 100 cansend information on the first screen image 300, which includes the imageaccording to the executed specific function, to the display device 200.

If so, the second controller 280 of the display device 200 controls thesecond screen image 500 corresponding to the received first screen image300 to be displayed on the monitor window 400. Therefore, a user canindirectly manipulate the mobile terminal 100 by manipulating themonitor window 400 of the display device 200 instead of directlymanipulating the mobile terminal 100. And, the user can recognize thefirst screen image 300 of the mobile terminal 100 by viewing the secondscreen image 500 of the display device 200.

It is not mandatory for the monitor window 400 to have a shape identicalor similar to one face of the housing having the first display unit 151of the mobile terminal 100 loaded thereon. For instance, other icons(e.g., a window close icon, a window minimize icon, a window maximizeicon, etc.) (Not shown in the drawing) can be further shown in themonitor window 400 in addition to one face of the housing.Alternatively, the second screen image 500 can be displayed on themonitor window 400 without the shape of the housing face.

Further, the display device 200 receives information on the first screenimage 300 from the mobile terminal 100 and then displays the receivedinformation as the second screen image 500 on the monitor window 400.Therefore, the first screen image 300 and the second screen image 500can share a content image generated from the mobile terminal 100 witheach other.

FIG. 3 exemplarily shows that the content image generated from themobile terminal 100 is a standby image, by which the present embodimentis non-limited. The content image generated from the mobile terminal 100includes an image related to every function, menu or applicationexecuted in the mobile terminal 100.

In the following description, how the mobile terminal 100 provides theinformation on the first screen image 300 to the display device 200 isexplained in detail.

First of all, the first controller 180 of the mobile terminal 100captures the first screen image 300 displayed on the first display unit151 and transmits the captured first screen image 300 as the aforesaidinformation on the first screen 300 to the display device 200.Afterwards, the second controller 280 of the display device 200 receivesthe captured first screen image 300 and then controls the received firstscreen image 300 to be displayed as the second screen image 500 on themonitor window 400.

In doing so, the first screen image 300 and the second screen image 500can depend on each other when zooming in or zooming out, for example. Inparticular, if the first screen image 300 zooms in or out, the secondscreen image 500 can zoom in or out correspondingly. Moreover, contentsof the first and second screen images 300 and 500 can become dependenton each other.

Otherwise, the first controller 180 of the mobile terminal 100 cantransmit a video signal input to the first display unit 151 to thedisplay device 200 as the information on the first screen image 300. Thefirst display unit 151 of the mobile terminal 100 can then output thevideo signal as the first screen image 300. Meanwhile, the secondcontroller 280 of the display unit 200 receives the transmitted videosignal and outputs the received video signal as the second screen image500 to the monitor window 400 of the second display unit 251. Inparticular, the first display unit 151 and the second display unit 251can share the video signal output from the first controller 180 witheach other. In the following description, the video signal is named ashared video signal.

In this instance, the first screen image 300 and the second screen image500 can also depend on each other when zooming in or zooming out, forexample. In particular, if the first screen image 300 zooms in or out,the second screen image 500 can zoom in or out correspondingly.Moreover, contents of the first and second screen images 300 and 500 canalso become dependent on each other.

Further, the first controller 180 of the mobile terminal 100 generates afirst video signal and a second video signal independent from the firstvideo signal, both first and second video signals relating to a specificcontent image generated from the mobile terminal 100. The firstcontroller 180 can input the first video signal to the first displayunit 151 and transmits the second video signal as the information on thefirst screen image 300 to the display device 200. The first display unit151 of the mobile terminal 100 then outputs the first video signal asthe first screen image 300.

Meanwhile, the second controller 280 of the display device 200 receivesthe transmitted second video signal and outputs the received secondvideo signal as the second screen image 500 on the monitor window 400 ofthe second display unit 251. It should be noted that each of the firstand second video signals should be discriminated from the shared videosignal in that the first video signal and the second video signal areindependently provided to the first display unit 151 and the seconddisplay unit 251, respectively.

In this instance, the first screen image 300 and the second screen image500 can become independent from each other when zooming in and zoomingout, for example. In particular, the second screen image 500 can zoom inor out irrespective of the zoom adjustment of the first screen image300. Moreover, the first screen image 300 and the second screen image500 can become independent from each other in their contents. Thezoom-in and zoom-out features of each of the first screen image 300 andthe second screen image 500 are described again later.

In the above description, as the mobile terminal 100 and the displaydevice 200 are connected to each other, the first screen image 300displayed on the first display unit 151 and the monitor window 400 andthe second screen image 500 displayed on the second display unit 251 areschematically explained.

In the following description, the first screen image 300, the monitorwindow 400 and the second screen image 500 are explained in more detailwith reference to FIGS. 4 to 10. In the following description, both ofthe first display unit 151 of the mobile terminal 100 and the seconddisplay unit 251 of the display device 200 can include touchscreens,respectively. Yet, the embodiment of the present invention is appliednot only to the first and second display units 151 and 251 including thetouchscreens, but also to the first and second display units 151 and 251including normal displays.

FIG. 4 is a flowchart according to an embodiment of the presentinvention. Referring to FIG. 4, the first screen image 300 is displayedon the first display unit 151 of the mobile terminal 100 (S41), and themobile terminal 100 is connected to the display device 200 (S42).Alternatively, the steps S41 and S42 can be performed in reverse orderor at the same time. Details of the steps S41 and S42 are omitted fromthe following description for clarity, because the steps S41 and S42were described with reference to FIG. 3.

As the mobile terminal 100 and the display device 200 are connected toeach other, the monitor window 400 is generated on the second displayunit 251 of the display device 200. Further, the second screen image 500corresponding to the first screen image 300 is displayed on the monitorwindow 400 (S43).

How the monitor window 400 is generated on the second display unit 251is explained in detail with reference to FIG. 5 as follows. Referring toFIG. 5, at least one of objects A, B, C . . . can be displayed on thesecond display unit 251 of the display device 200 in advance. In thisinstance, ‘object’ means a graphic interface prepared for interactionwith a user and can include at least one of a menu icon, a file icon, anexecute icon, a thumbnail, a link, a text input box and the like. InFIG. 5, it is assumed that the object includes an icon or the like.

Referring to FIG. 5 (5-1), when the mobile terminal 100 and the displaydevice 200 are connected to each other, the second controller 280 of thedisplay device 200 can control a generated position of the monitorwindow 400 to be determined by having no consideration of the objectspreviously displayed on the second display unit 251 of the displaydevice 200. In particular, the monitor window 400 can be generated toblock the objects in order to be displayed at a specific position.

Referring to FIG. 5 (5-2), when the mobile terminal 100 and the displaydevice 200 are connected to each other, the second controller 280 of thedisplay device 200 can control a generated position of the monitorwindow 400 to be determined in consideration of the objects previouslydisplayed on the second display unit 251 of the display device 200. Inparticular, the monitor window 400 can be generated at an appropriateposition to avoid blocking the objects.

Moreover, referring to FIG. 5 (5-3), the second controller 280 of thedisplay device 200 can control a generated position and size of themonitor window 400 to be determined in consideration of the objectspreviously displayed on the second display unit 251. In particular, themonitor window 400 can be generated with an appropriate size at anappropriate position to avoid blocking the objects. Of course, theposition and size of the generated monitor window 400 can be adjusted bya user's manipulation.

The first screen image 300 and the second screen image 500 are describedin detail with reference to FIG. 6 as follows. Referring to FIG. 6(6-1), at least one of objects 301, 303, 305 and 307 for the contentimage can be displayed on the first screen image 300. For clarity of thefollowing description, the object in the first screen image 300 is nameda first object.

Further, objects 501, 503, 505 and 507 respectively corresponding to thefirst objects 301, 303, 305 and 307 can be displayed on the secondscreen image 500. For clarity of the following description, the objectin the second screen image 500 is named a second object.

The first specific object 303 for execution of a message menu can beselected from the first screen image 300 of the mobile terminal 100, forexample. When the first display unit 151 of the mobile terminal 100includes a touchscreen, the first specific object 303 can be selected bybeing touched. If so, the first controller 180 of the mobile terminal100 controls the message menu to be executed based on the selection ofthe first specific object 303.

Alternatively, when the specific second object 503 corresponding to thefirst specific object 303 is selected from the second screen image 500of the display device 200, the second controller 280 of the displaydevice 200 transmits a control signal to the mobile terminal 100 toindicate that the specific second object 503 has been selected. In thisinstance, the selection of the specific second object 503 can beperformed by clicking a mouse. Alternatively, if the second display unit251 includes a touchscreen, the selection of the specific second object503 can be performed by touching the specific second object 503. Thesecond controller 280 of the display device 200 can then transmit acontrol signal to the mobile terminal to indicate a mouse-click positionor touch position on the monitor. If so, the first controller 180 of themobile terminal 100 controls the message menu to be executed based onthe control signal.

Once the message menu is executed in the mobile terminal 100, referringto FIG. 6 (6-2), the first controller 180 of the mobile terminal 100controls a content image according to the executed message menu to bedisplayed as the first screen image 300 on the first display unit 151,and controls the content image according to the executed message menu tobe displayed as the second screen image 500 on the monitor window 400 ofthe second display unit 251.

In the following description, an orientation direction of the monitorwindow 400 within the second display unit 251 according to anorientation direction of a housing of the mobile terminal 100 anddisplay directions of first and second screen images 300 and 500according to the orientation direction are described in detail withreference to FIGS. 7 and 8.

As mentioned in the foregoing description with reference to FIG. 6, thefollowing situation is assumed. First of all, the housing of the mobileterminal 100 is positioned in a vertical direction. Secondly, themonitor window 400 is positioned in the vertical direction on the seconddisplay unit 251. Thirdly, a display direction of the first screen image300 of the first display unit 151 is a portrait direction. Fourthly, adisplay direction of the second screen image 500 of the second displayunit 251 is the portrait direction.

Referring to FIG. 7 (7-1), an orientation direction of the housing ofthe mobile terminal 100 can be changed when a user arranges the housingof the mobile terminal 100 in a horizontal direction by turning thehousing of the mobile terminal 100 counterclockwise. If so, the firstcontroller 180 of the mobile terminal 100 can detect the changedorientation direction via the first sensing unit 140. The firstcontroller 180 of the mobile terminal 100 can then provide the detectedchanged orientation direction to the display device 200 (S44).

Subsequently, referring to FIG. 7 (7-2), the second controller 280 ofthe display device 200 controls the monitor window 400 to be arranged ina horizontal direction by turning the monitor window 400counterclockwise according to the changed orientation direction (S45).

Meanwhile, referring to FIG. 7 (7-3), the first controller 180 of themobile terminal 100 controls the first screen image 300 in the firstdisplay unit 151 to be displayed in a landscape direction based on thechanged orientation direction. The first controller 180 of the mobileterminal 100 can then provide the display device 200 with information onthe first screen image 300 according to the landscape direction.

If so, referring to FIG. 7 (7-4), the second controller 280 of thedisplay device 200 controls the second screen image 500 in the monitorwindow 400 arranged in the horizontal direction to be displayed in thelandscape direction. When the orientation direction of the monitorwindow 400 is changed in the second display unit 251, a size of themonitor window 400 can be adjusted in consideration of objects existingas a neighbor to the monitor window 400. This is further explained withreference to FIG. 8 as follows.

Referring to FIG. 8 (8-1), the monitor window 400 is oriented in thevertical direction on the second display 251 of the display device 200.In this instance, the monitor window 400 is displayed in a first size inconsideration of the objects A, B, C . . . arranged around the monitorwindow 400. In particular, the first size can include a maximum sizeenough not to block the objects neighbor to the monitor window 400 whenthe monitor window 40 is arranged in the vertical direction.

As mentioned in the foregoing description, as the orientation directionof the housing of the mobile terminal 100 is changed, the orientationdirection of the monitor window 400 can be changed into the horizontaldirection. In doing so, referring to FIG. 8 (8-2), unless the monitorwindow 400 blocks the neighbor objects, the second controller 280 of thedisplay device 200 can control the size of the monitor window 400changed in the horizontal direction to be maintained intact in the firstsize.

Alternatively, referring to FIG. 8 (8-3), when the monitor window 400 isarranged in the horizontal direction, the second controller 280 of thedisplay device 200 can enlarge the monitor window 400 into a secondsize, which is a maximum size large enough not to block the neighborobjects, in consideration of the arrangement of the neighbor objects.

In the description with reference to FIG. 7, the orientation directionof the monitor window 400 is changed according to the orientationdirection of the housing of the mobile terminal 100. However, it is notmandatory for the orientation direction of the monitor window 400 in thedisplay unit 251 to be determined by the orientation direction of thehousing of the mobile terminal 100. This is further described withreference to FIG. 9 as follows.

As mentioned in the foregoing description with reference to FIG. 7(7-4), the following situation is assumed. First of all, the housing ofthe mobile terminal 100 is positioned in a horizontal direction.Secondly, the monitor window 400 is positioned in the horizontaldirection on the second display unit 251. Thirdly, a display directionof the first screen image 300 of the first display unit 151 is alandscape direction. Fourthly, a display direction of the second screenimage 500 of the second display unit 251 is the landscape direction.

Referring to FIG. 9 (9-1), when a prescribed user command is input tothe display device 200, the second controller 280 of the display device200 can control the monitor window 400 to be oriented in the verticaldirection by being turned clockwise. FIG. 9 (9-1) shows that the seconddisplay 251 of the display device 200 includes a touchscreen. Inparticular, referring to FIG. 9 (9-1), after two positions on themonitor window 400 have been simultaneously touched, if the touch isrotated clockwise, the monitor window 400 is turned clockwise as well.Further, no limitation is put on the prescribed user command input tothe display device 200 for the rotation of the monitor window 400.

Once the monitor window 400 is oriented in the vertical direction, thesecond controller 280 of the display device 200 transmits a controlsignal to the mobile terminal 100 to indicate that the monitor window400 has been oriented in the vertical direction. If so, referring toFIG. 9 (9-2), the first controller 180 of the mobile terminal 100controls the display direction of the first screen image 300 to bechanged into the portrait direction despite that the housing of themobile terminal 100 keeps being oriented in the horizontal direction.

In addition, the first controller 180 of the mobile terminal 100 cancontrol information on the first screen image 300 changed into theportrait direction to be transmitted to the display device 200.Subsequently, the second controller 280 of the display device 200receives the information on the first screen image 300, and controls thesecond screen image 500 to be displayed in the portrait direction.

Referring to FIG. 9 (9-3), a user can orient the housing of the mobileterminal 100 in the vertical direction again by turning the housing ofthe mobile terminal 100 clockwise. Yet, because the first screen image300 of the mobile terminal 100 is already displayed in the portraitdirection, the display direction of the first screen image 300 may notbe changed. Moreover, because the first controller 180 of the mobileterminal 100 determines that the monitor window 400 has already beenoriented in the vertical direction via the former control signal, acontrol signal may not be transmitted to the display device 200 toindicate that the housing of the mobile terminal 100 is oriented in thevertical direction again. Even if the latter control signal istransmitted to the display device 200 to indicate that the housing ofthe mobile terminal 100 is oriented in the vertical direction again, thesecond controller 280 of the display device 200 can ignore thecorresponding control signal because the monitor window 400 is alreadyoriented in the vertical direction.

If the first controller 180 of the mobile terminal 100 captures thefirst screen image 300 and then transmits the captured first screenimage 300 as information on the first screen image 300 to the displaydevice 200 or if the first controller 180 of the mobile terminal 100transmits the share video signal input to the first display unit 151 tothe display device 200, referring to FIG. 9, a display direction of thefirst screen image 300 is equal to that of the second screen image 500.

Yet, if the first controller 180 of the mobile terminal 100 generates afirst video signal and a second video signal independent from the firstvideo signal and then transmits the first video signal and the secondsignal to the first display unit 151 and the display device 200,respectively, a display direction of the first screen image 300 can beindependent from that of the second screen image 500. This is describedin detail with reference to FIG. 10 as follows.

As mentioned in the foregoing description with reference to FIG. 9(9-1), when a prescribed user command is input to the display device200, the second controller 280 of the display device 200 can control themonitor window 400 to be oriented in the vertical direction by beingturned clockwise. Once the monitor window 400 is oriented in thevertical direction, the second controller 280 of the display device 200can transmit a control signal to the mobile terminal 100 to indicatethat the monitor window 400 has been oriented in the vertical direction.

Subsequently, the first controller 180 of the mobile terminal 100transmits a second video signal of a portrait direction corresponding tothe monitor window 400 of the vertical direction to the display device200. If so, referring to FIG. 10 (10-1), the second controller 280 ofthe display device 200 controls the second screen image 500 to bedisplayed in the portrait direction according to the second videosignal.

And, the first controller 180 of the mobile terminal 100 can keepproviding the first video signal in a landscape direction independentfrom the second video signal, which corresponds to the housing of themobile terminal 100 oriented in the horizontal direction, to the firstdisplay unit 151. Therefore, referring to FIG. 10 (10-1), the firstscreen image 300 can keep being displayed on the first display unit 151in the landscape direction.

Referring to FIG. 10 (10-2), a user can orient the housing of the mobileterminal 100 in the vertical direction again. If so, the firstcontroller 180 of the mobile terminal 100 can control the first videosignal, which enables the first screen image 300 to be displayed in theportrait direction to correspond to the housing of the mobile terminal100 oriented in the vertical direction, to be provided to the firstdisplay unit 151. And, the first controller 180 of the mobile terminal100 keeps transmitting the second video signal corresponding to themonitor window 400 of the vertical direction to the display device 200,thereby controlling the second screen image 500 to keep being displayedin the portrait direction on the second display unit 251.

In the above description, the display directions of the first and secondscreen images 300 and 500 and the orientation direction of the monitorwindow 400 due to the orientation direction of the housing of the mobileterminal 100 are explained. Zoom-in and zoom-out features of each of thefirst and second screen images 300 and 500 and enlargement and reductionof the monitor window 400 will now be explained with reference to FIGS.11 and 12.

In particular, FIG. 11 is a flowchart according to an embodiment of thepresent invention, and FIG. 12 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention. Referring to FIG.12 (12-1), the first screen image 300 is displayed on the first display151 of the mobile terminal 100, the monitor window 400 is displayed onthe second display 251 of the display device 200, and the second screenimage 500 is displayed on the monitor window 400.

In doing so, a user command for zooming in the first screen image 300 onthe mobile terminal 100 can be input (S111). For instance, the usercommand for the zoom-in feature can be input by performing two toucheson two positions on the first display unit (e.g., a touchscreen) 151simultaneously and dragging the touches in a pinching-out direction.Alternatively, the user command for the zoom-in feature can be input viaa user manipulation performed on the first user input unit 130.

Subsequently, referring to FIG. 12 (12-2), the first controller 180 ofthe mobile terminal 100 controls the first screen image 300 to be zoomedin (S112). The first controller 180 of the mobile terminal 100 thentransmits a second video signal independent from a first video signalfor the zoomed-in first screen image 300 to the display device 200. Inthis instance, the second video signal can include information on theoriginal first screen image 300 before the zoom-in.

If so, the second controller 280 of the display device 200 can control asize of the monitor window 400 to be maintained intact (S113). Thesecond controller 280 of the display device 200 can then control a zoomlevel of the second screen image 500 to be maintained intact bymaintaining a size of the second screen image 500 as it is (S114).Alternatively, referring to FIG. 12 (12-3), while the first controller180 of the mobile terminal 100 controls the first screen image 300 to bezoomed in (S112), the first controller 180 of the mobile terminal 100can provide information on the zoomed-in first screen image 300 to thedisplay device 200. In this instance, the information on the zoomed-infirst screen image 300 can include a captured image of the first screenimage 300 or the share video signal input to the first display unit 151.

If so, the second controller 280 of the display device 200 can controlthe size of the monitor window 400 to be maintained intact (S113), andcontrol the second screen image 500 to be zoomed in by maintaining thesize of the second screen image 500 (S115). Alternatively, referring toFIG. 12 (12-4), the first controller 180 of the mobile terminal 100 cancontrol the first screen image 300 to be zoomed in (S112). And, thefirst controller 180 of the mobile terminal 100 can provide a controlsignal to the display device 200 to indicate that the first screen image300 has been zoomed in.

The second controller 280 of the display device 200 can also increasethe size of the monitor window 400 in proportion to a level of thezoom-in according to the control signal (S116). Subsequently, the firstcontroller 180 of the mobile terminal 100 can transmit a second videosignal independent from the first video signal for the zoomed-in firstscreen image 300 to the display device 200. In this instance, the secondvideo signal can include the original first screen image 300 before thezoom-in.

If so, the second controller 280 of the display device 200 can control azoom level of the second screen image 500 to be maintained intact whilethe second screen image 500 is enlarged and displayed on the enlargedmonitor window (S117). In particular, a rectangular part 510 representedas a dotted line within the second screen image 500 shown in FIG. 12(12-4) can correspond to the entire second screen image 500 shown inFIG. 12 (12-3). Besides, it is not mandatory for the rectangular part510 represented as the dotted line to be displayed in FIG. 12 (12-4).

In this disclosure, the concept of ‘zoom-in’ of an image isdiscriminated from the concept of ‘enlargement’ of an image. Inparticular, if a range of a content of an image displayed within aboundary of the image is decreased irrespective of whether the boundaryof the image is enlarged or reduced, the image is ‘zoomed in’. On thecontrary, irrespective of a change of a zoom level of an image, if aboundary of the image is enlarged, the image is ‘enlarged’.

For instance, if the second screen image 500 shown in FIG. 12 (12-1) ischanged into the second screen image 500 shown in FIG. 12 (12-3), thesecond screen image 500 is not ‘enlarged’ but ‘zoomed in’. In anotherinstance, if the second screen image 500 shown in FIG. 12 (12-1) ischanged into the second screen image 500 shown in FIG. 12 (12-4), thesecond screen image 500 is not ‘zoomed in’ but ‘enlarged’.

The following description is made with reference to FIGS. 13 and 14. Inparticular, FIG. 13 is a flowchart according to an embodiment of thepresent invention, and FIG. 14 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention.

Referring to FIG. 14 (14-1), the first screen image 300 is displayed onthe first display 151 of the mobile terminal 100, the monitor window 400is displayed on the second display 251 of the display device 200, andthe second screen image 500 is displayed on the monitor window 400.

In doing so, a user command for zooming out the first screen image 300on the mobile terminal 100 can be input (S131). For instance, the usercommand for the zoom-out feature can be input by performing two toucheson two positions on the first display unit (e.g., a touchscreen) 151simultaneously and dragging the touches in a pinching-in direction.Alternatively, the user command for the zoom-out feature can be inputvia a user manipulation performed on the first user input unit 130.

Subsequently, referring to FIG. 14 (14-2), the first controller 180 ofthe mobile terminal 100 controls the first screen image 300 to be zoomedout (S132). The first controller 180 of the mobile terminal 100 thentransmits a second video signal independent from a first video signalfor the zoomed-out first screen image 300 to the display device 200. Inthis instance, the second video signal can include information on theoriginal first screen image 300 before the zoom-out. If so, the secondcontroller 280 of the display device 200 controls a size of the monitorwindow 400 to be maintained intact (S133). The second controller 280 ofthe display device 200 then controls a zoom level of the second screenimage 500 to be maintained intact by maintaining a size of the secondscreen image 500 as it is (S134).

Alternatively, referring to FIG. 14 (14-3), while the first controller180 of the mobile terminal 100 controls the first screen image 300 to bezoomed out (S132), the first controller 180 of the mobile terminal 100can provide information on the zoomed-out first screen image 300 to thedisplay device 200. In this instance, the information on the zoomed-outfirst screen image 300 can include a captured image of the first screenimage 300 or the share video signal input to the first display unit 151.If so, the second controller 280 of the display device 200 can controlthe size of the monitor window 400 to be maintained intact (S133), andcontrol the second screen image 500 to be zoomed out by maintaining thesize of the second screen image 500 (S135).

Alternatively, referring to FIG. 14 (14-4), the first controller 180 ofthe mobile terminal 100 can control the first screen image 300 to bezoomed out (S132), and provide a control signal to the display device200 to indicate that the first screen image 300 has been zoomed out.

The second controller 280 of the display device 200 can also thenincrease the size of the monitor window 400 in proportion to a level ofthe zoom-out according to the control signal (S136). Subsequently, thefirst controller 180 of the mobile terminal 100 can provide informationon the zoomed-out first image 300 to the display device 200. In thisinstance, the information on the zoomed-out first screen image 300 caninclude a captured image of the first screen image 300 or the sharevideo signal input to the first display unit 151.

If so, the second controller 280 of the display device 200 can controlthe second screen image 500 to be zoomed out while the second screenimage 500 is displayed as being enlarged on the monitor window 400(S137). In particular, the rectangular part 510 represented as a dottedline within the second screen image 500 shown in FIG. 14 (14-4)corresponds to the entire second screen image 500 shown in FIG. 14(14-1). However, it is not mandatory for the rectangular part 510represented as the dotted line to be displayed in FIG. 14 (12-4).

Further, the concept of ‘zoom-out’ of an image is discriminated from theconcept of ‘reduction’ of an image. In particular, if a range of acontent of an image displayed within a boundary is increasedirrespective of whether the boundary of the image is enlarged orreduced, the image is ‘zoomed out’. On the contrary, irrespective of achange of a zoom level of an image, if a boundary of the image isreduced, the image is ‘reduced’.

For instance, if the second screen image 500 shown in FIG. 14 (14-1) ischanged into the second screen image 500 shown in FIG. 14 (14-3), thesecond screen image 500 is not ‘reduced’ but ‘zoomed out’. In anotherinstance, if the second screen image 500 shown in FIG. 14 (14-4) ischanged into the second screen image 500 shown in FIG. 14 (14-3), thesecond screen image 500 is not ‘zoomed out’ but ‘reduced’. In stillanother instance, if the second screen image 500 shown in FIG. 14 (14-1)is changed into the second screen image 500 shown in FIG. 14 (14-4), thesecond screen image is enlarged as well as zoomed out.

The above description explains inputting a user command for zooming inor out the first screen image 300 in the mobile terminal 100. In thefollowing description, zooming in (or enlarging) or zooming out (orreducing) the second screen image 500 in the display device 200 will beexplained with reference to FIGS. 15 and 16.

In particular, FIG. 15 is a flowchart according to an embodiment of thepresent invention, and FIG. 16 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention. Referring to FIG.16 (16-1), the first screen image 300 is displayed on the first display151 of the mobile terminal 100, the monitor window 400 is displayed onthe second display 251 of the display device 200, and the second screenimage 500 is displayed on the monitor window 400.

In doing so, a user command for zooming in or enlarging the secondscreen image 500 in the display device 200 can be input (S151). Forinstance, the user command for the zoom-in or enlargement can be inputby performing two touches on two positions on the second screen image500 of the monitor window 400 of the second display unit (e.g., atouchscreen) 251 simultaneously and dragging the touches in apinching-out direction. Alternatively, the user command for the zoom-inor enlargement can be input via a user manipulation performed on thesecond user input unit 230 of the display device 200.

According to whether the user command is a command for zooming in thesecond screen image 500 or a command for enlarging the second screenimage 500, the first screen image 300 can vary more differently. This isexplained in detail as follows. First of all, the user command isassumed to be the zoom-in command. If so, the second controller 280 ofthe display device 200 can transmit a control signal to the mobileterminal 100 to indicate that the zoom-in command of the second screenimage 500 has been input. If so, the first controller 180 of the mobileterminal 100 transmits a video signal corresponding to the controlsignal to the display device 200.

Subsequently, referring to FIG. 16 (16-2), the second controller 280 ofthe display device 200 controls the second screen image 500 to be zoomedin using the video signal (S152), and controls a size of the monitorwindow 400 to be maintained intact (S153). Referring again to FIG. 16(16-2), the first controller 180 of the mobile terminal 100 controls azoom level of the first screen image 300 to be not changed in the firstdisplay unit 151 irrespective of the control signal (S154).

Then, the second controller 280 of the display device 200 transmits acontrol signal to the mobile terminal 100 to indicate that the zoom-incommand of the second screen image 500 has been input. If so, the firstcontroller 180 of the mobile terminal 100 transmits a video signalcorresponding to the control signal to the display device 200.

Referring to FIG. 16 (16-3), the second controller 280 of the displaydevice 200 controls the second screen image 500 to be zoomed in usingthe video signal (S152), and controls a size of the monitor window 400to be maintained intact (S153). Referring again to FIG. 16 (16-3), thefirst controller 180 of the mobile terminal 100 controls the firstscreen image 300 to be zoomed in to cope with the control signal (S155).

Next, the user command is assumed to be the enlargement command. If so,it may be unnecessary for the second controller 280 of the displaydevice 200 to transmit the control signal indicating that theenlargement command of the second screen image 500 has been input to themobile terminal 100.

Instead, referring to FIG. 16 (16-4), the second controller 280 of thedisplay device 200 controls the second screen image 500 to be enlargedwithout adjustment of the zoom level of the second screen image 500(S152). As the second screen image 500 is enlarged, the secondcontroller 280 of the display device 200 controls the size of themonitor window 400 to be enlarged (S156).

Moreover, referring again to FIG. 16 (16-4), because the firstcontroller 180 of the mobile terminal 100 does not receive any controlsignal from the display device 200, the first screen image 300 on thefirst display unit 151 can be maintained as it is. Namely, the zoomlevel of the first screen image 300 is not adjusted (S157).

Meanwhile, the rectangular part 510 represented as a dotted line withinthe second screen image 500 shown in FIG. 16 (16-4) can correspond tothe entire second screen image 500 shown in FIG. 16 (16-3). However, itis not mandatory for the rectangular part 510 represented as the dottedline to be displayed in FIG. 16 (16-4).

The following description is made with reference to FIGS. 17 and 18. Inparticular, FIG. 17 is a flowchart according to an embodiment of thepresent invention, and FIG. 18 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention.

Referring to FIG. 18 (18-1), the first screen image 300 is displayed onthe first display 151 of the mobile terminal 100, the monitor window 400is displayed on the second display 251 of the display device 200, andthe second screen image 500 is displayed on the monitor window 400.

In doing so, a user command for zooming out or reducing the secondscreen image 500 in the display device 200 can be input (S171). Forinstance, the user command for the zoom-out or reduction can be input byperforming two touches on two positions on the second screen image 500of the monitor window 400 of the second display unit (e.g., atouchscreen) 251 simultaneously and dragging the touches in apinching-in direction. Alternatively, the user command for the zoom-outor reduction feature can be input via a user manipulation performed onthe second user input unit 230 of the display device 200.

According to whether the user command is a command for zooming out thesecond screen image 500 or a command for reducing the second screenimage 500, the first screen image 300 can vary more differently. This isexplained in detail as follows.

First of all, the user command is assumed to be the zoom-out command. Ifso, the second controller 280 of the display device 200 transmits acontrol signal to the mobile terminal 100 to indicate that the zoom-outcommand of the second screen image 500 has been input. The firstcontroller 180 of the mobile terminal 100 then transmits a video signalcorresponding to the control signal to the display device 200.

Subsequently, referring to FIG. 18 (18-2), the second controller 280 ofthe display device 200 controls the second screen image 500 to be zoomedout using the video signal (S172), and controls a size of the monitorwindow 400 to be maintained intact (S173). Referring to FIG. 18 (18-2),the first controller 180 of the mobile terminal 100 controls a zoomlevel of the first screen image 300 to be not changed in the firstdisplay unit 151 irrespective of the control signal (S174).

The user command is still assumed to be the zoom-out command. If so, thesecond controller 280 of the display device 200 transmits a controlsignal to the mobile terminal 100 to indicate that the zoom-out commandof the second screen image 500 has been input. The first controller 180of the mobile terminal 100 then transmits a video signal correspondingto the control signal to the display device 200.

If so, referring to FIG. 18 (18-3), the second controller 280 of thedisplay device 200 controls the second screen image 500 to be zoomed outusing the video signal (S172), and controls a size of the monitor window400 to be maintained intact (S173). Referring to FIG. 18 (18-3), thefirst controller 180 of the mobile terminal 100 controls the firstscreen image 300 to be zoomed out to cope with the control signal(S175).

Next, the user command is assumed to be the reduction command. If so, itmay be unnecessary for the second controller 280 of the display device200 to transmit the control signal, which indicates that the reductioncommand of the second screen image 500 has been input, to the mobileterminal 100.

Instead, referring to FIG. 18 (18-4), the second controller 280 of thedisplay device 200 can control the second screen image 500 to be reduced(S172). As the second screen image 500 is reduced, the second controller280 of the display device 200 can control the size of the monitor window400 to be reduced as well (S176).

Moreover, referring to FIG. 18 (18-4), because the first controller 180of the mobile terminal 100 does not receive any control signal from thedisplay device 200, the first screen image 300 on the first display unit151 can be maintained as it is. Namely, the zoom level of the firstscreen image 300 is not adjusted (S177).

Meanwhile, the rectangular part 510 represented as a dotted line withinthe second screen image 500 shown in FIG. 18 (18-4) can correspond tothe entire second screen image 500 shown in FIG. 18 (18-3). However, itis not mandatory for the rectangular part 510 represented as the dottedline to be displayed in FIG. 18 (18-3).

In the above description, the second screen image 500 is zoomed in/outor enlarged/reduced in the display device 200. In the followingdescription, the monitor window 400 being enlarged or reduced in thedisplay device 200 is made with reference to FIGS. 19 and 20.

In particular, FIG. 19 is a flowchart according to an embodiment of thepresent invention, and FIG. 20 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention. Referring to FIG.20 (20-1), the first screen image 300 is displayed on the first display151 of the mobile terminal 100, the monitor window 400 is displayed onthe second display 251 of the display device 200, and the second screenimage 500 is displayed on the monitor window 400.

A user command for enlarging the monitor window 400 in the displaydevice 200 is then input (S191). For instance, the user command for theenlargement can be input by performing a touch on a corner part of themonitor window 400 and then dragging the touch in a radial directionaway from a center of the monitor window 400. Alternatively, the usercommand for the enlargement can be input via a user manipulationperformed on the second user input unit 230 of the display device 200 aswell. The monitor window 400 can also be enlarged to become an entirescreen in the second screen image 500.

Subsequently, referring to FIG. 20 (20-2), the second controller 280 ofthe display device 200 controls the monitor window 400 to be enlarged(S192). Further, the second controller 280 of the display device 200controls the second screen image 500 to be enlarged in the enlargedmonitor window 400 (S193), and controls a zoom level of the secondscreen image 500 to be not changed (S194).

In addition, it may not be necessary for the second controller 280 ofthe display device 200 to transmit a control signal, which indicatesthat the user command for the enlargement of the monitor window 400 hasbeen input, to the mobile terminal 100.

Therefore, referring to FIG. 20 (20-2), because the first controller 180of the mobile terminal 100 does not receive any control signal from thedisplay device 200, the first screen image 300 in the first display unit151 can be maintained as it is. Namely, a zoom level of the first screenimage 300 does not change (S195). The description with reference to FIG.20 (20-2) may have the same principle of the former description withreference to FIG. 16 (16-4).

Alternatively, when the second screen image 500 is enlarged in theenlarged monitor window 400, the second controller 280 of the displaydevice 200 can transmit a control signal, which indicates that the usercommand for the enlargement of the monitor window 400 has been input, tothe mobile terminal 100. If so, the first controller 180 of the mobileterminal 100 can transmit a video signal corresponding to the controlsignal to the display device 200.

Referring to FIG. 20 (20-3), the second controller 280 of the displaydevice 200 can control the second screen image 500 to be zoomed out inthe enlarged monitor window 400 using the video signal (S196). Referringto FIG. 20 (20-3), the first controller 180 of the mobile terminal 100can control the zoom level of the first screen image 300 not to changein the first display unit 151 irrespective of the control signal (S197).

Alternatively, referring to FIG. 20 (20-4), when the second screen image500 is zoomed out, the first controller 180 of the mobile terminal 100controls the first screen image 300 to be zoomed out in the firstdisplay unit 151 to cope with the control signal (S198).

Meanwhile, the rectangular part 510 represented as a dotted line withinthe second screen image 500 shown in FIG. 20 (20-3) or (20-4) cancorrespond to the entire second screen image 500 shown in FIG. 20(20-1). However, it is not mandatory for the rectangular part 510represented as the dotted line to be displayed in FIG. 20 (20-4).

The following description is made with reference to FIGS. 21 and 22. Inparticular, FIG. 21 is a flowchart according to an embodiment of thepresent invention, and FIG. 22 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention.

Referring to FIG. 22 (22-1), the first screen image 300 is displayed onthe first display 151 of the mobile terminal 100, the monitor window 400is displayed on the second display 251 of the display device 200, andthe second screen image 500 is displayed on the monitor window 400.

A user command for reducing the monitor window 400 in the display device200 is then input (S211). For instance, the user command for thereduction can be input by performing a touch on a corner part of themonitor window 400 and then dragging the touch in a radial directiontoward a center of the monitor window 400. Alternatively, the usercommand for the reduction can be input via a user manipulation performedon the second user input unit 230 of the display device 200 as well.

Subsequently, referring to FIG. 22 (22-2), the second controller 280 ofthe display device 200 controls the monitor window 400 to be reduced(S212). In addition, the second controller 280 of the display device 200controls the second screen image 500 to be reduced in the reducedmonitor window 400 (S213). However, the second controller 280 of thedisplay device 200 can control a zoom level of the second screen image500 not to be changed (S214).

Further, it may not be necessary for the second controller 280 of thedisplay device 200 to transmit a control signal, which indicates thatthe user command for the reduction of the monitor window 400 has beeninput, to the mobile terminal 100.

Therefore, referring to FIG. 22 (22-2), because the first controller 180of the mobile terminal 100 does not receive any control signal from thedisplay device 200, the first controller 180 can maintain the firstscreen image 300 in the first display unit 151 as it is. Namely, a zoomlevel of the first screen image 300 does not change (S215).

The description with reference to FIG. 22 (22-2) may have the sameprinciple of the former description with reference to FIG. 18 (18-4).Alternatively, when the second screen image 500 is reduced in thereduced monitor window 400, the second controller 280 of the displaydevice 200 can transmit a control signal, which indicates that the usercommand for the reduction of the monitor window 400 has been input, tothe mobile terminal 100. If so, the first controller 180 of the mobileterminal 100 can transmit a video signal corresponding to the controlsignal to the display device 200.

If so, referring to FIG. 22 (22-3), the second controller 280 of thedisplay device 200 controls the second screen image 500 to be zoomed inusing the video signal (S216). Referring to FIG. 22 (22-3), the firstcontroller 180 of the mobile terminal 100 can control the zoom level ofthe first screen image 300 not to change in the first display unit 151irrespective of the control signal (S217).

Alternatively, referring to FIG. 22 (22-4), when the second screen image500 is zoomed in, the first controller 180 of the mobile terminal 100can control the first screen image 300 to be zoomed in on the firstdisplay unit 151 to cope with the control signal (S218). Meanwhile, therectangular part 510 represented as a dotted line within the secondscreen image 500 shown in FIG. 22 (22-1) can correspond to the entiresecond screen image 500 shown in FIG. 22 (22-4). However, it is notmandatory for the rectangular part 510 represented as the dotted line tobe displayed in FIG. 22 (22-1).

The following description is made with reference to FIGS. 23 and 24. Inparticular, FIG. 23 is a flowchart according to an embodiment of thepresent invention, and FIG. 24 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention.

Referring to FIG. 24 (24-1), the first screen image 300 is displayed onthe first display 151 of the mobile terminal 100, the monitor window 400is displayed on the second display 251 of the display device 200, andthe second screen image 500 is displayed on the monitor window 400. Aspecific one object (e.g., an object C) can be touched and selected fromfirst objects displayed on the first screen image 300 in the mobileterminal 100 (S231).

Subsequently, the first controller 180 of the mobile terminal 100controls an image corresponding to the specific object to be displayedas the first screen image 300 on the first display unit 151 as beingzoomed in at a specific zoom level (S232).

Further, the first controller 180 of the mobile terminal 100 can providea picture of the image as information on the first screen image 300 tothe display device 200. If so, referring to FIG. 24 (24-2), the secondcontroller 280 of the display device 200 controls the picture of theimage to be displayed as the second screen image 500 on the seconddisplay unit 251 as being zoomed out at a level lower than the specificzoom level (S233). In this instance, the picture of the image can bedisplayed as being fully zoomed out. The picture of the image can alsobe displayed as an entire screen on the second display unit 251.

Moreover, the second controller 280 of the display device 200 controls aregion 510 corresponding to the first screen image 300 to be displayedon the second display unit 251 as being visually discriminated.Afterwards, a touch can be performed on the first display unit 151 ofthe mobile terminal 100 and can be then dragged in a prescribeddirection.

If so, referring to FIG. 24 (24-3), the first controller 180 of themobile terminal 100 controls the first screen image 300 to be scrolledin the prescribed direction. The second controller 280 of the displaydevice 200 then controls the region 510 corresponding to the scrolledfirst screen image 300 to be displayed as being visually discriminated.

How the monitor window 400 is generated from the second display 251 ofthe display device 200 when the mobile terminal 100 and the displaydevice 200 are connected to each other will now be explained withreference to FIGS. 25 and 26. In particular, FIG. 25 is a flowchartaccording to an embodiment of the present invention, and FIG. 26 is adiagram of a front side of the mobile terminal 100 and a display unit ofthe display device 200 according to an embodiment of the presentinvention.

Referring to FIGS. 25 and 26, as mentioned in the foregoing description,the mobile terminal 100 and the display device 200 can be connected toeach other (S251). Referring to FIG. 26 (26-1), at least one of thefirst controller 180 of the mobile terminal 100 and the secondcontroller 280 of the display device 200 can control the monitor window400 not to be directly generated from the second display unit 251 evenif the mobile terminal 100 and the display device 200 are connected toeach other.

For instance, referring to FIG. 26 (26-1), the first controller 180 ofthe mobile terminal 100 can control information on the first screenimage 300 not to be provided. Alternatively, the second controller 280of the display device 200 can control the monitor window 400 not to begenerated from the second display unit 251 irrespective of whether theinformation on the first screen image 300 is received from the mobileterminal 100.

Subsequently, a prescribed user command for enabling the monitor window400 to be generated from the second display unit 251 can be input to themobile terminal 100 (S252). For instance, the user command forgenerating the monitor window 400 can be input by performing a touch anddrag on the first display unit (e.g., touchscreen) 151 along with astraight line trace in one direction or a trace of a specific pattern.Alternatively, the user command for generating the monitor window 400can be input via a user manipulation performed on the first user inputunit 130 of the mobile terminal 100.

When the prescribed user command is input, referring to FIG. 26 (26-2),at least one of the first controller 180 of the mobile terminal 100 andthe second controller 280 of the display device 200 can control themonitor window 400 to be generated from the second display unit 251 ofthe display device 200 (S253).

For instance, the first controller 180 of the mobile terminal 100 canprovide the display device 200 with a control signal indicating that theprescribed user command has been input. The first controller 180 of themobile terminal 100 can also provide the display device 200 withinformation on the first screen image 300.

If so, referring to FIG. 26 (26-2), the second controller 280 of thedisplay device 200 can control the monitor window 400 to be generatedfrom the second display unit 251 in response to the control signal. Thesecond controller 280 of the display device 200 can also control thesecond screen image 500 to be displayed on the monitor window 400 usingthe information on the first screen image 300 provided by the mobileterminal 100.

Meanwhile, referring to FIG. 26 (26-3), when the monitor window 400 isgenerated from the display device 200, the first controller 180 of themobile terminal 100 controls the power consumption of the mobileterminal 100 to be saved by automatically turning off the first displayunit 151 not to display the first screen image 300. Optionally, when themobile terminal 100 and the display device 200 are disconnected fromeach other, if the first display 151 of the mobile terminal 100 isautomatically turned on, the first controller 180 of the mobile terminal100 can control the first screen image 300 to be displayed again in thefirst display 151.

How the monitor window 400 displayed on the second display unit 251changes according to a distance between the mobile terminal 100 and thedisplay device 200 or a communication signal strength after the mobileterminal 100 and the display device 200 have been connected to eachother will now be explained with reference to FIGS. 27 and 28.

In particular, FIG. 27 is a flowchart according to an embodiment of thepresent invention, and FIG. 28 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention. Referring to FIGS.27 and 28, as mentioned in the foregoing description, the mobileterminal 100 and the display device 200 can be connected to each other(S271). If so, as mentioned in the foregoing description, referring toFIG. 28 (28-1), the monitor window 400 can be displayed on the seconddisplay 251 of the display device 200 (S272).

A terminal user can then change a spaced distance between the mobileterminal 100 and the display device 200 by shifting at least one of themobile terminal 100 and the display device 200. When the mobile terminal100 and the display device 200 are wirelessly connected to each other,the variation of the spaced distance in-between can bring a variation ofa communication signal strength in-between.

If so, at least one of the first controller 180 of the mobile terminal100 and the second controller 280 of the display device 200 can vary asize of the monitor window 400 according to the communication signalstrength (S273). In particular, the second controller 280 of the displaydevice 200 controls the size of the monitor window 400 to vary accordingto the communication signal strength, and controls a second screen image500 to be displayed on the monitor window 400 as being enlarged orreduced to fit the size of the monitor window 400.

Moreover, the first controller 180 of the mobile terminal 100 canprovide the display device 200 with information on a first screen image300 corresponding to the monitor window 400 having the size varyingaccording to the communication signal strength.

Referring to FIG. 28 (28-2), if the communication signal strengthbecomes stronger as the spaced distance between the mobile terminal 100and the display device 200 decreases, at least one of the firstcontroller 180 of the mobile terminal 100 and the second controller 280of the display device 200 can control the size of the monitor window 400to increase according to the stronger communication signal strength.

Referring to FIG. 28 (28-3), if the communication signal strength isweakened as the spaced distance between the mobile terminal 100 and thedisplay device 200 increases, at least one of the first controller 180of the mobile terminal 100 and the second controller 280 of the displaydevice 200 can control the size of the monitor window 400 to decreaseaccording to the weakened communication signal strength. Also, if thecommunication between the mobile terminal 100 and the display device 200is disconnected as the spaced distance increases enough, the monitorwindow 400 can disappear from the second display unit 251.

How the monitor window 400 displayed on the second display unit 251varies when a user input is not performed on the mobile terminal 100 fora prescribed period of time will now be explained with reference toFIGS. 29 and 30.

In particular, FIG. 29 is a flowchart according to an embodiment of thepresent invention, and FIG. 30 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention.

Referring to FIGS. 29 and 30, after the mobile terminal 100 and thedisplay device 200 have been connected to each other, a user input maynot be performed on the mobile terminal 100 for a prescribed period oftime (S291). No user input in the mobile terminal 100 means that thetouchscreen or user input unit 130 of the mobile terminal 100 is notmanipulated.

Afterwards, as the first display unit 151 is automatically turned off,the first controller 180 of the mobile terminal 100 can control thefirst screen image 300 not to be further displayed (S292). Also, if auser input is performed on the mobile terminal 100, the display unit 151can be automatically turned on.

Subsequently, the first controller 180 of the mobile terminal 100provides the display device 200 with a control signal, which indicatesthat the user input has not been performed on the mobile terminal 100for the prescribed period of time, if necessary. If so, referring toFIG. 30 (30-1), the second controller 280 of the display device 200keeps displaying the monitor window 400 on the second display unitdespite that the first display unit 151 of the mobile terminal 100 isturned off, and controls the second screen image 500 to keep beingdisplayed on the monitor window 400 (S293).

Alternatively, referring to FIG. 30 (30-2), in response to the controlsignal indicating that the first display 151 of the mobile terminal 100has been turned off, the second controller 280 of the display device 200keeps displaying the monitor window 400 on the second display unit 251,but controls the second screen image 500 to be not displayed on themonitor window 400 (S294). In particular, the second screen image 500can be blanked on the monitor window 400.

If a control signal indicating that the first display unit 151 is turnedon is received from the mobile terminal 100, the second controller 280of the display device 200 controls the second screen image 500 to bedisplayed again on the monitor window 400. Alternatively, referring toFIG. 30 (30-3), in response to the control signal indicating that thefirst display 151 of the mobile terminal 100 has been turned off, thesecond controller 280 of the display device 200 can control the monitorwindow 400 not to be displayed on the second display unit 251. When themonitor window 400 is not displayed, the second screen image 500 is notdisplayed on the monitor window 400.

If a control signal indicating that the first display unit 151 is turnedon is received from the mobile terminal 100, the second controller 280of the display device 200 controls the monitor window 400 to bedisplayed again, and controls the second screen image 500 to bedisplayed again on the monitor window 400. After the mobile terminal 100and the display device 200 have been connected to each other and aprescribed event occurs in the mobile terminal 100, the monitor window400 can change. This feature will now be explained with reference toFIGS. 31 and 32.

In particular, FIG. 31 is a flowchart according to an embodiment of thepresent invention, and FIG. 32 is a diagram of a front side of themobile terminal 100 and a display unit of the display device 200according to an embodiment of the present invention. First, an ‘event’corresponds to a specific function being executed without a user inputin the mobile terminal 100 during a normal operation of the mobileterminal 100. For example, the event can include one of a phone callreception, a message reception and the like. The following descriptionassumes the event includes the phone call reception, by which thepresent embodiment is non-limited.

Referring to FIGS. 31 and 32, as mentioned in the foregoing description,the mobile terminal 100 and the display device 200 can be connected toeach other (S311). If so, the monitor window 400 is generated from thesecond display 251 of the display device 200 and the second screen image500 can be displayed on the monitor window 400.

Afterwards, a phone call reception even can occur in the mobile terminal100. If so, the first screen image 300 on the display unit 151 of themobile terminal 100 can be changed into an image corresponding to thephone call reception event. Accordingly, the second screen image 500 onthe second display 251 of the display device 200 can be changed into theimage corresponding to the phone call reception event, which isoptional.

If so, the first controller 180 of the mobile terminal 100 determineswhether the mobile terminal 100 is currently in a mute mode. In thisinstance, the mute mode may mean the mode set for muting an alarm soundindicating an occurrence of an event in the mobile terminal 100. Also,the mute mode can include a vibration mode for generating a vibrationindicating an occurrence of an event in the mobile terminal 100.

As a result of the determination, if the mobile terminal 100 is in themute mode, the first controller 180 of the mobile terminal 100 providesthe display device 200 with a first control signal indicating that theevent has occurred in the mobile terminal 100 and that the mobileterminal 100 is in the mute mode.

Then, in response to the first control signal, the second controller 280of the display device 200 controls the monitor window 400 to be visuallychanged in the second display unit 251. Referring to FIG. 32 (32-2), themonitor window 400 vibrates on the second display unit 251 according tothe first control signal, by which the present embodiment isnon-limited. Optionally, at least one of a color, shape and size of themonitor window 400 can be changed in response to the first controlsignal.

On the contrary, as a result of the determination, if the mobileterminal 100 is not in the mute mode, the first controller 180 of themobile terminal 100 provides the display device 200 with a secondcontrol signal indicating that the event has occurred in the mobileterminal 100 and that the mobile terminal 100 is not in the mute mode.

Then, in response to the second control signal, the second controller280 of the display device 200 controls the monitor window 400 to bemaintained intact without being visually changed in the second displayunit 251.

If the mobile terminal 100 is not in the mute mode, the first controller180 of the mobile terminal 100 does not send any control signal to thedisplay device 200. Therefore, the second controller 280 of the displaydevice 200 can control the monitor window 400 to keep being displayed asit is.

As mentioned in the foregoing description, the present invention isapplicable to such a mobile terminal as a mobile phone, a smart phone, anotebook computer e.g., a laptop), a digital broadcast terminal, a PDA(personal digital assistants), a PMP (portable multimedia player), anavigation system and the like and/or such a display device as anotebook computer (e.g., laptop), a tablet computer, a desktop computer,a television set (e.g., a digital TV set, a smart TV set, etc.) and thelike.

It will be apparent to those skilled in the art that variousmodifications and variations can be specified into other form(s) withoutdeparting from the spirit or scope of the inventions.

In addition, the above-described methods can be implemented in a programrecorded medium as computer-readable codes. The computer-readable mediainclude all kinds of recording devices in which data readable by acomputer system are stored. The computer-readable media include ROM,RAM, CD-ROM, magnetic tapes, floppy discs, optical data storage devices,and the like for example and also include carrier-wave typeimplementations (e.g., transmission via Internet). And, the computer caninclude the controller 180 of the terminal.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A mobile terminal, comprising: a first displayunit configured to display a mobile screen image; an interface unitconfigured to be connected to an external display device having a seconddisplay unit for displaying a monitor window for displaying a monitorscreen image; and a controller configured to: receive a control signalrelating to a modification of the mobile screen image from the externaldisplay device, wherein a housing of the mobile terminal is in a firstorientation direction, control the mobile screen image to be modified inresponse to the control signal, even though the first orientationdirection of the housing of the mobile terminal is not changed into asecond orientation direction, and provide a modified mobile screen imageto the external display device, wherein the external display devicemaintains the monitor window in the first orientation direction, eventhough an orientation direction of the mobile screen image is changedfrom the first orientation direction to the second orientationdirection.
 2. The mobile terminal of claim 1, wherein the modifiedmobile screen image is displayed on the first display unit despite thatthe orientation direction of the housing is not changed.
 3. The mobileterminal of claim 1, wherein the mobile screen image and the monitorscreen image share a content image related to a menu or applicationexecuted in the mobile terminal.
 4. The mobile terminal of claim 1,wherein the mobile terminal further includes a wireless communicationunit to interface with the external display device.
 5. The mobileterminal of claim 1, wherein the mobile terminal further includes awired data port to interface with the external display device.
 6. Themobile terminal of claim 1, wherein the mobile terminal further includesa sensing unit configured to sense the orientation direction of thehousing.
 7. A system, comprising: a display device having a seconddisplay unit for displaying a monitor window for displaying a monitorscreen image; and a mobile terminal including a first display unit fordisplaying a mobile screen image and a controller, wherein thecontroller of the mobile terminal is configured to: interface to thedisplay device, receive a control signal relating to a modification ofthe mobile screen image from the display device, wherein a housing ofthe mobile terminal is in a first orientation direction, control themobile screen image to be modified in response to the control signal,even though the first orientation direction of the housing of the mobileterminal is not changed into a second orientation direction, and providea modified mobile screen image to the display device, wherein thedisplay device maintains the monitor window in the first orientationdirection, even though an orientation direction of the mobile screenimage is changed from the first orientation direction to the secondorientation direction.
 8. The system of claim 7, wherein the modifiedmobile screen image is displayed on the first display unit despite thatthe orientation direction of the housing is not changed.
 9. The systemof claim 7, wherein the mobile screen image and the monitor screen imageshare a content image related to a menu or application executed in themobile terminal.
 10. The system of claim 7, wherein the mobile terminaland the display device are interfaced to each other through a wirelesscommunication unit.
 11. The system of claim 7, wherein the mobileterminal and the display device are interfaced to each other through awired data port.
 12. The system of claim 7, wherein the monitor windowhas a substantially identical shape to one face of the housing of themobile terminal.
 13. A method for displaying a mobile screen image in amobile terminal, the method comprising: interfacing to an externaldisplay device having a second display unit for displaying a monitorwindow for displaying a monitor screen image; receiving a control signalrelating to a modification of the mobile screen image from the externaldisplay device, wherein a housing of the mobile terminal is in a firstorientation direction; controlling the mobile screen image to bemodified in response to the control signal, even though the firstorientation direction of the housing of the mobile terminal is notchanged into a second orientation direction; and providing a modifiedmobile screen image to the external display device, wherein the externaldisplay device maintains the monitor window in the first orientationdirection, even though an orientation direction of the mobile screenimage is changed from the first orientation direction to the secondorientation direction.
 14. The method of claim 13, further including:displaying the modified mobile screen image on the first display unit ofthe mobile terminal despite that the orientation direction of thehousing is not changed.
 15. The method of claim 13, wherein the mobilescreen image and the monitor screen image share a content image relatedto a menu or application executed in the mobile terminal.
 16. The methodof claim 13, wherein the interfacing to the external display device isthrough a wireless communication unit.
 17. The method of claim 13,wherein the interfacing to the external display device is through awired data port.